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(57) Abstract 

A method and apparatus for transmitting data between nodes 
(10) connected to a oonomunications bus (14), preferably a computer 
backbone, divides a full bus width into a plurality of sub-buses (26a. 
26b, 26c). Each sub-bus can be independently operated, and each 
node on the network can connect to one or more of the sub-buses. The 
apparatus provides, at a transmitting node, a determination of which 
sub-buses are available (24) to transmit a data packet to one or more 
receiving nodes. The data words are divided into sub-words, thereby 
redudng the memory access time requirements and saving memory 
costs* In aooordance with a particular embodiment, the header, at the 
begirming of the data packet, and the error check control, provided at 
the end of the data packet, are sent at a slower speed than the data in- 
formation portion of the packet The data information portion of the 
packet is sent at the highest speed compatible ^th the receiving node 
or nodes. In case one sub-bus fails, a node can transmh data over the 
other sub-buses available to it. 
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METHOD AND APPARATUS FOR CONCURRENT PACKET BUS 

Backgrouad of the Invention 

The invention relates generally to data packet 
coiomuni cat ions systems/ and more particularly to a method 
and apparatus for transmitting data on a wide, high speed 
data bus. 

As the available data transmission speed of networks 
increases, the hardware connecting to those networks must 
similarly increase in speed. Thus, hardware connected to 
a 16 megabit per second bus runs substantially more 
slowly than that hardware connected to a 100 megabit per 
second bus. Since the slower hardware is less expensive 
than the faster hardware, a hidden, and not insubstantial 
cost of increasing bus throughput is the price of the 
processing hardware to which it is connected. 

The hardware costs of the bus transmitter/receiver.^ 
circuitries include not only the particular drivers 
connected to the bus, but the memories, logic gates, etc. 
which also need to operate more quickly to properly use 
the faster bus. In particular, memory access 
requirements increase in direct proportion to the bus 
speed. The added cost of faster memory is especially 
burdensome . 

The typical response to increased bus throughput, 
however, has and continues to be faster hardware. That 
faster hardware includes also faster control logic and 
processors and increases the cost of the entire network 
connection circuitry. To date, no alternative has been 
available to control network board costs while still 
operating a higher speed bus at its full capacity. 

It is therefore an object of the invention to 
provide alternative circuit configurations for using high 
speed buses while controlling connection costs and memory 
costs i Other objects of the invention are a method and 
apparatus having high reliability, simplicity of 
structure, and redundancy in circuit use. 
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Summary of the Invention 

The invention thus relates to a method and apparatus 
for transmitting data between nodes connected to a 
communications bus where the bus width is at least equal 
to the number of bits in a data word to be transmitted on 
the bus. The method features the steps of connecting 
each node to the communications bus over at least one 
subset of bus lines, the combination of the subsets of 
bus lines including the entire bus. The method further 
features determining, at a transmitting node, those bus 
subsets over which the transmitting node can communicate 
with an intended destination node, and sending each data 
word to the destination node as a sequence of subwords 
over a bus subset selected from those determined bus 
subsets. 

The method, in a particular embodiment, further 
features appending, as a header to the data words, a 
sequence of destination node identification symbols, and 
appending at the end of the sequence of data words, error 
checking information data for checking, at the 
destination node, the accuracy of the received data 
words . 

In another aspect, the method features sending, from 
the destination node, and during a data transmission, a 
flow control signal for informing or warning the 
transmitting source node of an overflow error condition 
occurring at the destination node. The method can 
further feature selecting, at the transmitting node, a 
speed at which to send the data words and ensuring that 
all header information is sent at a slow bus speed which 
can be read by all nodes connected to the selected bus 
subset. In addition, the error checking information data 
can also be sent at the slow bus speed, to provide the 
destination node with the time required to check the 
error checking information data to ensure accuracy of 
transmission. 
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The apparatus of the invention relates to 
transmitting data between nodes connected to a 
communications bus, the bus having a bus width at least 
equal to the data words to be transmitted. The apparatus 
features circuitry for connecting each node to the 
communications bus over at least one subset of bus lines, 
hereafter called a sub-bus, a combination of the sub- 
buses covering, collectively, the entire communications 
bus. The apparatus further features circuitry for 
determining, at a transmitting node, those sub-buses over 
which the transmitting node can communicate with an 
intended destination node, and further, circuitry for 
sending each data word as a time sequence of subwords 
over a sub-bus selected from those determined acceptable 
sub-buses. 

In preferred embodiments of the invention, the 
apparatus further features circuitry for appending a 
header to the beginning of the sequence of data words, 
the header including destination node identification 
symbols, and circuitry for appending at the end of the 
sequence of data words for a packet, an error checking 
information data for enabling the destination node to 
check the accuracy of the received data words. Circuitry 
also can be provided for sending from the destination 
node, during a data transmission, an overflow warning 
signal for informing the transmitting node of for 
example, an overflow error condition at the destination 
node • 

The apparatus can further feature circuitry which 
selects a speed at which to send the data words but, 
however, which sends all header information, and 
preferably the error checking information data, at a slow 
bus speed which can be read by all nodes connected to the 
sub-bus. With regard to the error checking information 
data, the slower speed enables the destination node to 
perform error checking in real time since the error 
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checking method is a substantially time consuming 
process. 

Brief Description o£ the Drawings 

Other objects, features r and advantages of the 
invention will be apparent from the following 
descriptionr taken together with the drawings , in which: 

Figure 1 is a block diagram of a transmitter 
circuitry in accordance with a preferred embodiment of 
the invention; 

Figure lA is a diagram of a data packet; 

Figure IB is a representation of the lines of a sub- 
bus in accordance with the invention; 

Figure IC is a representation of a slot mask in 
accordance with the invention; 

Figure 2 is a state diagram for the transmitter node 
in accordance with the invention; 

Figure 3 is a detailed diagram of the transmitter 
data path circuitry; 

Figure 4 is a state diagram of the receiver node in 
accordance with a preferred embodiment of the invention; 

Figure 5 is a circuit configuration for a receiver 
input data path in accordance with a preferred embodiment 
of the invention; 

Figure 5 is a timing diagram for data transmission 
on the sub-bus; and 

Figure 7 is a timing diagram illustrating a 
particular bus arbitration strategy in accordance with 
invention. 

Description of a Preferred Embodiment 

Referring to Figure 1, in accordance with the 
inventionr a transmitter/receiver apparatus 10 passes 
data between a memory bus 12 and a wide bus 14 which can 
ber for example/ a standard wide bus, thirty-two data 
bits in width r such as a computer internal backbone. 
Preferably, the bus has, also, a plurality of control 
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lines. A transmitter section 20 and a receiver section 
21 of each node are connected to one such memory bus or 
its equivalent. Also connected to the memory bus are a 
CPD 50 and a memory storage element 52. 

The transmitter section 20 of the apparatus has a 
transmitter dequeue circuitry 22 which receives data to 
be transmitted over bus 14 from the memory bus 12. The 
data includes destination data and information data to be 
used at the destination node or nodes. The transmitter 
dequeue circuitry makes the destination data available to 
a bus selection apparatus 24 which selects which of a 
plurality of sub-buses (26a, 26b, ... 26n) of bus 14 will 
be employed in connection with the transmission of this 
data. Once the selection has been made, the data is 
delivered to a connected single packet DMA transmission 
circuitry (28a, 28b, ... 28n) for each selected sub-bus 
and which operates at a speed selected by a speed 
selection circuitry 30. The output of the single packet 
DMA circuitry is passed to a connected driver (32a, 32b, 
... 32n) for transmission to the respective sub-bus. 

information is transmitted over the sub-bus 26 in a 
data packet 33; and each packet has a header 33a, which 
includes destination node identification information and 
other protocol information if necessary, a data portion 
33b and an error checking portion 33c (Fig. lA) . Each 
network node, connected to bus 14, is connected to one or 
more of the sub-buses 26. Each receiving (destination) 
node examines each of the packets available to it, over 
each of the sub-buses to which it is connected, using a 
single packet DMA receiver circuitry (40a, 40b, ... 40n) . 
Each receiver circuitry 40 receives the data packet from 
the sub-bus through a respective receiver driver (42a, 
42b ... 42n). An output of the packet DMA receiver 
circuitries is delivered to a receiver dequeue/enqueue 
circuitry 46 and data packets can be stored in selected 
buffers as described in more detail below. 



wo 93/07569 



PCrAJS92/07941 



-6- 

The sub-buses (26a/ 26b ... 26n) together include 
all of the lines of bus 14. In a typical example/ bus 14 
is a 32-bit wide bus which is divided into four 8-bit 
wide sub-buses. Each sub-bus has both data lines 43a and 
control lines 43b (Figure IB). The bus 14 can operate, 
over its entire width/ at/ for example/ 100 megabits per 
second/ and correspondingly/ each sub-bus operates at 25 
megabits per second. Accordingly/ since each node will 
transmit data to a specific destination node on only one 
sub-bus in accordance with the invention, the node 
operates at the slower speed of 25 megabits per second. 
ThuS/ for example, where there are memory accesses across 
a 32-bit word, there need only be one memory access along 
bus 12 for each four "subword" transmissions along an 
eight wide bit sub-bus 26 of bus 14. Accordingly, only 
one memory access is required for each group of subwords 
and the memory access circuitry for each node need 
operate at only a fraction of the speed at which a node 
transmitting across the entire width of bus 14, each 
clock cycle, would be required to operate. At the same 
time, however/ the operation of a plurality of nodes / on 
the different sub-buses of bus 14, enables the bus 14 to 
operate efficiently at its full capacity. In this 
manner, the cost of memory at each node can be 
substantially reduced because the access time required of 
each memory can be greater than that otherwise associated 
with and required by the full bus 14. On the other hand, 
when all sub-buses are operating, the data transmission 
rate on bus 14 appears to be at the full capacity of bus 
14. 

In a preferred embodied of the invention, the sub- 
buses need not operate in a synchronized manner. 
However, in accordance with the described embodiment of 
the invention, there are also provided three control 
lines for each sub-bus, to be described below, to further 
enhance operation of the bus system. 
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Considering the circuitry of Figure 1 in more 
detail r the transmit dequeue circuitry 22 dequeues a 
packet provided from the CPU or, under the control of the 
CPU, from memory, and makes the destination address data 
available to the bus selection circuitry 24 over lines 
€0. The destination data is made available as a "slot 
mask** 61, at the bus selection circuitry 24, The slot 
mask (Fig. IC) is a two byte word, in the illustrated 
embodiment, wherein a "one" bit represents a destination 
("slot") address for the packet. A packet can have 
multiple destinations, in which case the slot mask has 
multiple bits set, each bit (of the two byte mask in the 
illustrated embodiment) representing a different 
destination. The slot mask is compared to existence maps 
in a slot existence map (a data map array) circuitry 62. 
The slot existence map indicates, for each destination 
node, which sub-buses can be used for the transfer of 
data between nodes. 

Thus, the slot mask provides a bit position for each 
of the nodes connected to bus 14 (Fig. IC); and for each 
sub-bus, the existence of a set bit in the existence map 
for that sub-bus indicates a receiver connection of that 
node to the sub-bus, while the absence of a set bit 
indicates the absence of an interface connection, for 
that destination node, to the sub-bus. As a result of 
the comparison, there are typically one or more sub-buses 
which can be used to transmit a data packet to the 
selected destination(s) . From the set of available sub- 
buses provided by existence map circuitry 62, the bus 
selection circuitry 24 selects one sub-bus^ at random in 
the illustrated embodiment, as the transmission carrier. 

The bus selection circuitry also sends the packet 
destination slot mask to the speed selection circuitry 
30. The speed selection circuitry 30 examines a stored 
speed map 64 to determine the maximum data rate at which 
the packet data can be sent to the selected 
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de5tination(s} . Thereafter, once the speed and the sub- 
bus have been determined, the information data is made 
available to the selected transmitter single packet DMA 
circuitry(s) and the data are sent over the sub-bus (es) 
by that transmit DMA circuitry(s) through its associated 
driver (s) 32 when control of the bus(es) has been made 
available to the associated transmit DMA (as described 
below) . Thereafter the process is repeated for each 
successive packet to be transmitted. 

In a particularly preferred embodiment of the 
invention, the CPU can designate a specific sub-bus to be 
employed in the transmission process thus bypassing the 
sub-bus selection circuitry 24 of the transmitter 
section. 

At the receiver, each receiver single packet DMA 
circuitry 40 monitors all packets on its connected sub- 
bus. Whenever a packet is found to include the 
predetermined receiver slot number, specified by the 
destination slot mask in the packet header, a dequeue 
request is issued by the receiver circuitry 40 to the 
receiver dequeue/enqueue circuitry 46. The receiver 
dequeue/enqueue logic circuitry 46 then obtains a buffer, 
which is available from a pool of free buffers provided 
by the CPU, and the address of the buffer is sent to the 
requesting receiver DMA circuitry 40. The receiver DMA 
circuitry then DMA's the received packet directly into 
the designated buffer of memory. If the packet is 
received error-free, the buffer is made available to the 
receiver dec[ueue/enqueue circuitry 46 and is placed in a 
receiver queue at the CPU. If an error is detected, the 
receiver dequeue/enqueue circuitry places the allocated 
buffer back in the so-called "free" pool and the 
resulting data is effectively lost, and in not made 
availcJjle to the CPU. The operating system protocol 
handles a request for retransmittal of the packet. 
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In the operation of the circuitry of Figure Ir 
several protocol rules are preferably observed for 
increasing the operational efficiency and hence 
throughput of the circuitry. First, all transmissions 
start at the highest speed at which all nodes connected 
to a sub-bus will correctly process the received 
information. Thus, all header information is transmitted 
at a speed which enables each node connected to the sub- 
bus to determine whether it is the intended destination 
of the packet. Once the header information has been 
transmitted, the transmission speed can be increased if 
and only if all destination nodes can read, as indicated 
by the speed selection circuitry 30, information 
transmitted at the higher rate. In the event that more 
than one destination node is specified, that is, if the 
header information indicates a plurality of receivers are 
receiving a packet (as noted above, this can be easily 
implemented by setting the appropriate slot bits in the 
slot masks for the plural nodes), then the maximum speed 
at which the information can be sent over the sub-bus is 
the highest speed at which all receivers can receive and 
properly process the information. 

Once the data containing body of the packet has been 
transmitted, the transmitter, in the illustrated 
embodiment, sends an error check code which is processed 
by each of those receivers which were selected as 
destinations for the data. In the illustrated 
embodiment, since the error checking process is extremely 
complex and accordingly slow (at the receiver processing 
level), the transmitter slows the transmission rate to a 
low speed transmission which provides each receiver with 
adequate time to perform the necessary error checking 
process without an undue storage requirement at the 
receiving node. 

Referring to the transmitter state diagram of 
Figure 2, for an embodiment in which bus 14 is thirty-two 
bits wide with twelve control lines, and each sub-bus is 
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eigfat bits wide with three control lines, the transmitter 
requires four clock cycles of the bus to send a thirty- 
two bit wide word. The transmitter r when it initiates 
operation, thus resides in state 100, in which it is 
IDLE, Upon the beginning of a packet transmission, the 
transmitter sets a bus request; enters state 102 at which 
it checks to see that the BUS GRANT signal (a sub-bus 
control line) is not asserted and that the FRAME signal 
(a sub-bus control line) also is not asserted (refer to 
Figures 6 and 7 for timing diagrams of the bus operation 
and bus arbitration according to a preferred embodiment 
of the invention) . 

The transmitter then proceeds to a no operation 
(NOP) state 104. Thereafter the BUS REQ signal is 
asserted and thereafter the BOS GRANT is asserted. The 
FRAME signal is set in state 106 if the FLOW control 
signal over lines 109 (FIG. 3) (a warning bus control 
signal connected to all nodes) is not asserted, and the 
first, upper byte of the first word to be sent is 
transmitted at state 108. If the FLOW control signal 
remains not asserted, a second upper byte of the word is 
transmitted at state 110, a third byte at state 112, and 
a fourth and last byte of the thirty-two bit word is 
transmitted at state 114. Thereafter, if the FLOW 
control signal is still not asserted and the data packet 
is not complete as indicated by a "NOT DONE" signal on an 
internal control line 115, the transmitter cycles back to 
send the beginning of the next thirty-two bit word of the 
packet at state 108. If the FLOW signal is not asserted 
and the packet data transmission is complete (DONE is 
asserted), the transmitter begins to send the first byte 
of the error correction code as indicated at state 116. 
Thereafter the successive bytes of the thirty- two bit 
error correction code are sent at states 118, 120, and 
122. Finally, the FRAME signal is cleared (reset) at 
state 124 and the transmitter returns to its IDLE state 
100. 
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Referring to Figure 3, a typical transmitter 
structure receives the data over data lines 142 and 
synchronous with a clock signal over a sub-bus control 
line 140. The data passes through a thirty-two bit latch 
144 which latches the data at each fourth clock time so 
long as the FLOW signal is not enabled. The output of 
latch 144 is input to a multiplexer 146 which, in 
response to the clock signals , passes one or the other of 
the high and low order sixteen bits of the stored thirty-- 
two bit data word. The sixteen bit output of multiplexor 
146 is held in a latch 148, controlled in the same manner 
as latch 144, and the two eight-bit outputs of latch 148 
(high and low) are sequentially made available through 
multiplexer 150 to a third latch 152. The output of the 
third latch is made available to a sub-bus over a line 
154 through a driver 32. 

Timing for the transmitter data path is generated* 
through the EXCLUSIVE-OR gate 156, and bistable flip 
flops 158. So long as the FLOW signal is not eiiabled, 
this circuitry divides by two with an output level change 
on line 160 every clock cycle, and shifted by one-half of 
a clock cycle to allow setting of the output data at the 
output of latch 152. The transmitter circuitry also 
includes a FRAME signal generation logic 162, responsive 
to the clock signal 140 and an initialization signal over 
a line 164 from the CPU for generating the FRAME control, 
signal. 

Referring now to Figure 4, the receiver state 
diagram describes the operation of a receiver such as 
that illustrated schematically in Figure 5. At the 
receiver, the start or initiation of operation begins at 
a FLUSH state 170. On the trailing edge of the FEIAME 
signal, the receiver changes to a state 172 waiting there 
for the leading edge of the next FEU^HE signal. When the 
leading edge of the FRAME signal occurs (indicating the 
beginning of the next data packet), the receiver receives 
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the first eight-bit byte from the channel over the sub- 
bus at state 174. For each successive level change of 
the timing signal, the receiver advances to a next state 
176, 178, and either 180 or 170, as it reads each 
successive byte. After state 178, upon the next leading 
of the timing signal, the receiver either returns to the 
PLaSH state 170 which indicates that the packet slot bit 
was not set for that receiver and the packet should be 
ignored, or the receiver steps to state 180 because it 
recognizes that it is a destination for the incoming 
packet. At state 180, the receiver receives the entire 
packet and the end of the packet is indicated by the 
trailing edge of the FRAME signal, at which time, the 
receiver returns its normal IDLE state, state 172, 

Referring to Figure 5, a typical receiver data path 
provides for receiving eight bit wide data over lines 
190. The eight bit data bytes pass through latches 192, 
194 and 196 so that as each additional eight bits is 
received, the full thirty-two bit word is built up and is 
eventually stored in the latch 196 from which it is 
stored in a fifo buffer 198. The timing information is 
generated from the clock signal placed on the clock 
control line of the sub-bus by the transmitting node. 
Thus a level change occurs synchronously with the 
incoming data bytes and at the rate of the data byte 
transmission. At the first leading edge of the timing 
signal the first byte of a data word is stored in latch 
192. At the following trailing edge of the timing pulse, 
that first byte of data is stored in the lower order 
eight bits of latch 194, and the second byte of data, 
available from lines 190, is stored in the upper eight 
bits of latch 194. Latch 196 does not operate because 
the enabling load signal from a flipflop 200 is not yet 
available. (Flipflop 200 in effect acts like a divide- 
by-two counter and accordingly enables a trailing edge of 
the timing signal only for every other trailing edge, 
corresponding to every fourth incoming data byte). 



wo 93/07569 



PCT/US92/07941 



-13- 

Dpon the occurrence of the next leading edge of the 
timing signal on line 202, latch 192 again loads data 
into its register. This is the third byte of data in a 
four byte word. Dpon the occurrence of the next trailing 
edge, latch 196 will operate, loading the two bytes of 
data from latch 194 into its lower half, and the upper 
two bytes of data from the output of latch 192 and the 
data lines 190 into its upper half. The full word is 
then made available to the receiver fifo buffer 198. 

The operation of the circuitry associated with 
flipflop 200, which is enabled by the FRAME signal, is 
well known as a divide-by-two register. Accordingly, its 
operation in causing latch 196 to load only on every 
other trailing edge is well known to those of ordinary 
skill in the art. 

In addition, the logic of the receiver FIFO buffer 
X98, asserts the FLOW signal to prevent the FIFO buffet 
from overflowing in the event that the receiver FIFO 
buffer 198 is getting too full . Separately, an error 
(interrupt) line (not shown) is asserted if a CRC error 
occurs. A slot recognition circuit 222 is responsive to 
the output of latch 194, the timing signal, and the FRAME 
signal for recognizing, by a signal over a line 224 that 
the incoming packet is intended for this node. 

Referring now to Figures 6 and 7, the timing of the 
control signals available over the sub-bus was described 
generally in connection with the hardware of the 
transmitter and receiver circuitries. Once a transmitter 
has obtained access to the bus, it asserts the FRAME 
signal over line 206 which then "alerts" each of the 
connected receivers that a new data packet is 
forthcoming. The timing signals, applied at a slow rate 
with regard to the header, are applied to the clock 
control line 160 of the bus and provides the timing for 
the received signal over line 202. As shown on the data 
line 300 of Figure 6, the initial data (the header) is 
provided at a relatively slow rate, the intermediate data 
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information is provided at a fast rate, and the error 
control, (the CRC checksum in the illustrated embodiment) 
is provided at a slow rate. The timing signal, line 302, 
corresponds to the clock rate as described above. Iff at 
any time, the receiver falls behind, the receiver asserts 
the FLOW line 304 which causes the transmitter to stop 
transmission. If the FLOW line is asserted for less than 
a predetermined time, (corresponding to the receiver 
"catching up"), the receiver can negate the FLOW 
assertion and the transmitter will then continue to 
transmit data. (If the transmitter detects a FLOW 
assertion for more than this minimum period of time, the 
transmitter will ignore the PLOW signal and may thus 
overrun the receiver input FIFO buffer 198. If the 
receiver detects this buffer state, an overflow error 
occurs at the receiver.) 

Referring now to Figure 7, the bus arbitration 
strategy for the illustrated embodiment of the invention 
provides that a transmitter, which has information to 
transmit, asserts a BUS REQ signal 310 to a bus 
arbitration circuitry (not shown). Each node is 
connected directly to the arbitration circuitry in the 
illustrated embodiment, by two signal lines, a BOS REQ 
line and a BOS GRANT line. During an ongoing packet 
transmission, the bus arbitration circuitry examines the 
BUS REQ lines from all nodes and selects one requesting 
node at random, in this illustrated embodiment, and 
assets a BUS GRANT line 314 to that node. The BUS GRANT 
signal will enable the transmitter to raise the FRAME 
signal 320 (after that control signal is lowered by the 
presently transmitting node, as illustrated in Figure 7) 
and proceed to transmit data. During transmission, the 
BUS REQ signal is cleared by the transmitting node (as 
illustrated at 108 in Figure 2), and accordingly the BUS 
GRANT signal to the node is also cleared to its 
unasserted state. A next BUS REQ signal is then 
acknowledged by the arbitration circuitry. 
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In accordance with this particular embodiment of the 
invention, a data transfer mechanism is used wherein the 
data bus is divided into a plurality of independent sub- 
buses and each sub-bus operates "on its own" at all 
times. Each sub-bus, however, can act to "cover" for a 
failed sub-bus thus enabling, if the node has the 
appropriate connection, reliable communications to be 
achieved even when part of the bus channel is 
inoperative. Normally, however, all buses operate, and 
the memory access time requirements are minimized, 
enabling less expensive memory to be employed even though 
the full bus operates at a substantially higher transfer 
rate. 

Additions, subtractions, deletions, and other 
modifications of the invention will be apparent to those 
practiced in the art, and are within the scope of the 
following claims. 
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What is claimed is: 

1. A method for transmitting data between nodes 
connected on a communication bus having a bus width at 
least equal to a data word within the packet, comprising 
the steps of 

connecting each node to said communication bus over 
at least one subset of bus lines, a combination of the 
subsets of said bus lines comprising the entire bus, 

determining, at a transmitting node, those bus 
subsets over which the transmitting node can communicate 
with an intended destination node, and 

sending each data word as a sequence of subwords 
over a bus subset selected from those acceptable 
determined bus subsets. 

2. The method of claim 1 further comprising the steps 
of 

appending as a header to said data words, a sequence 
of destination node identification symbols, and 

appending, at the end of said sequence of data words 
an error checking information data for checking, at said 
destination node, the accuracy of the received data 
words. 

3. The method of claim 1 further comprising the step of 
sending over a bus subset control line, from the 

destination node during a data transmission, a warning 
signal for informing the transmitting node of an overflow 
condition at the destination node. 
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4. The method of claim 1 further comprising the steps 
of 

selecting, at the transmitting node, a maximum speed 
at which to send said data words, and 

sending all header information at a slow bus speed 
which can be read by all nodes connected to the bus 
subset. 

5. The method of claim 3 further comprising the step of 
sending said error checking information data at said 

slow bus speed. 

5. The method of claim 3 further comprising the steps 
of 

stopping transmission of said data packet upon 
receipt of said warning signal r and 

restarting transmission of said stopped data packet 
when said warning signal is removed from said overflow 
control line within a predetermined period of time. 

7. The method of claim 2 further comprising the steps 
Of 

forming a multibyte word for inclusion in said 
header, each node connected to the bus subset 
corresponding to a selected bit of said multibyte word, 
and 

setting, at the transmitter, at least one bit of 
said multibyte word, for designating the destination 
nodes of a packet to be transmitted. 

8. The method of claim 1 wherein said sending step 
further comprises the step of 

randomly selecting, from those acceptable determined 
bus subsets, the bus subset to be used for transmitting 
said data. 
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9. The method of claim 1 wherein said connecting step 

comprises the step of 

connecting each node to at least two subsets of said 

bus lines. 

10. Apparatus for transmitting data between nodes 
connected on a communication bus, said bus having a bus 
width at least equal to a data word within the packet, 
con^rising 

means for connecting each node to said communication 
bus over at least one subset of bus lines, a combination 
of the subsets of said bus lines comprising the entire 
communications bus, 

means for determining, at a transmitting node, those 
bus subsets over which the transmitting node can 
communicate with an intended destination node, and 

means for sending each data word as a sequence of 
subwords over a bus subset selected from those acceptable 
determined bus subsets. 

11. The apparatus of claim 10 further comprising 
means for appending as a header to said data words, 

a sequence of destination node identification symbols, 
and 

means for appending, at the end of said sequence of 
data words, an error checking information data for 
checking, at said destination node, the accuracy of the 
received data words. 

12. The apparatus of claim 10 further comprising 
means for sending, from the destination node during 

a data transmission, a warning signal for informing the 
transmitting node of an overflow condition at the 
destination node. 
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IS. The apparatus of claim 10 further comprising 

means for selecting, at the transmitting node, a 
maximum speed at which to send said data words, and 

means for sending all header information at a slow 
bus speed which can be read by all nodes connected to the 
bus subset. 

14. The apparatus of claim 13 further comprising 
means for sending said error checking information 

data at said slow bus speed. 

15. The apparatus of claim 13 further comprising 
means for stopping transmission of said data packet 

upon receipt of said error signal, and 

means for restarting transmission of said stopped 
data packet when said warning signal is removed from said 
control line within a predetermined period of time. 

16. The apparatus of claim 12 further comprising 
means for forming a multibyte word for inclusion in 

said header, each node connected to the bus subset 
corresponding to a selected bit of said multibyte word, 
and 

means for setting ^ at the transmitter, at least one 
bit of said multibyte word, for designating the 
destination nodes of a packet to be transmitted. 

17. The apparatus of claim 11 wherein said sending means 
further comprises 

means for randomly selecting, from those acceptable 
determined bus subsets, the bus subset to be used for 
transmitting said data. 

18. The apparatus of claim 11 wherein said connecting 
means comprises 

means for connecting each node to at least two 
subsets of said bus lines. 
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19. Apparatus for transmitting data between nodes 
connected on a comunication bus, said bus having a bus 
width at least equal to a data word within the packet, 
comprising 

means for connecting each node to said communication 
bus over at least one subset of bus lines, a combination 
of the subsets of said bus lines comprising the entire 
communications bus, 

means for determining, at a transmitting node, those 
bus subsets over which the transmitting node can 
communicate with an intended destination node, 

means for randomly selecting, from those acceptable 
determined bus subsets, the bus subsets to be used for 
transmitting said data, 

means for appending as a header to said data words, 
a sequence of destination node identification symbols, 

means for appending, at the end of said sequence of 
data words, an error checking information data for 
checking, at said destination node, the accuracy of the 
received data words, 

means for sending each data word as a sequence of 
subwords over the bus subset selected from those 
acceptable determined bus subsets, 

means for sending, from the destination node during 
a data transmission, a warning signal for informing the 
transmitting node of an overflow condition at the 
destination node, 

means for selecting, at the transmitting node, a 
maximum speed at which to send said data words, 

means for sending all header information at a slow 
bus speed which can be read by all nodes connected to the 

bus subset, and 

means for stopping transmission of said data packet 
upon receipt of said overflow signal. 
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20. A method for transmitting data between nodes 
connected to a communication bus having a bus width at 
least equal to a data word within the packet/ comprising 
the steps of 

connecting each node to said communication bus over 
at least one subset of bus lines r a combination of the 
subsets of said bus lines comprising the entire bus, 

determining, at a transmitting node, those bus 
subsets over which the transmitting node can communicate 
with an intended destination node, 

randomly selecting, from those acceptable determined 
bus subsets, the bus subset to be used for transmitting 
said data, 

appending as a header to said data words, a sequence 
of destination node identification symbols, 

appending, at the end of said sequence of data 
words, an error checking information data for checking^ 
at said destination node, the accuracy of the received 
data words, 

sending each data word as a sequence of subwords 
over a bus subset selected from those acceptable 
determined bus subsets, 

sending over a bus subset control line, from the 
destination node during a data transmission, an overflow 
error signal for informing the transmitting node of an 
overflow error condition at the destination node, 

sending all header information at a slow bus speed 
which can be read by all nodes connected to the bus 
subset, 

stopping transmission of said data packet upon 
receipt of said overflow error signal, 

restarting transmission of said stopped data packet 
when said overflow signal is removed from said error 
control line within a predetermined period of time, and 

connecting each node to at least two subsets of said 
bus lines. 
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